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CONCLKNIIJG  COMPuUND  fiAWDOMIZATION  IN  TH£  BINARY  SYbTQi 

By  John  E.  Woltth 
The  RAND  Corporation 

/  jLy 

conoider  a  set  of  approximately  random  binary  digits  obtained  by 

i  ^ 

some  experimental  process.  This  paper  outlines  a  method  of  compounding  the  digits  of  this 
set  to  obtain  a  smaller  set  of  binary  digits  wtiich  is  much  more  nearly  random.  The  method 
presented  has  the  property  that  the  number  of  digits  in  the  compounded  set  is  a  reasonably 
large  fraction  (say  of  the  raagnitudey^or>^  of  the  original  number  of  digits. 

If  a  set  of  very  nearly  random  decimal  digits  is  required,  this  can  be  obtained  by 
first  finding  a  set  of  very  nearly  random  binary  digits  and  then  converting  these  digits  te 
decimal  digits.  ^ 

The  concept  ofT^maximun  bias^is  introduced  to  measure  the  degree  of  randomness  of  a 
set  of  digits.  A  small  maximum  bias  shows  that  the  set  is  very  nearly  random. 

The  question  of  when  a  table  of  approximately  r'lndom  digits  can  be  considered  suitable 
for  use  as  a  random  digit  table  is  investigated.  It  is  found  that  a  table  will  be  satisfac¬ 
tory  for  the  usual  types  of  situations  to  w^dch  a  random  digit  table  is  applied  if  the 
reciprocal  of  the  number  of  digits  in  the  t<able  is  noticeably  greater  than  the  mAximua  bias 
of  the  table. 

2.  Introduclicfnl3nd  discussion.  With  the  development  of  the  theory  of  games  and  the 
more  widespread  use  of  experimental  methods  for  determining  approximate  distributions  fer 
statistics  whose  proAbility  laws  are  difficult  to  obtain  analytically,  a  demand  for  large 
sets  of  random  dlgitJ  has  arisen.  The  problem  of  obtaining  a  set  of  digits  which  can  be 
considered  sufficiently  random  for  the  situations  to  which  it  would  be  applied,  however,  la 
not  an  easy  one.  One  approach  to  this  problem  consists  in  obtaining  a  set  of  digits  by  s 
procedure  and  then  applying  tests  to  this  set  of  digits  to  determine  whether  it  can  be 
considered  satisfactory.  Although  appropriate  choice  of  the  tests  may  result  in  acceptanca 
of  sets  of  digits  which  are  suitable  for  certain  special  types  of  situations,  this  approach 
is  of  a  negative  character  and  does  not  prove  that  a  given  set  of  digits  is  sufficiently 
random;  it  merely  indicates  that  this  may  be  the  case.  V/hat  is  needed  is  a  constructive 
approach  to  the  problem,  i.e,,  a  method  of  constructing  a  set  of  random  digits  which  can 
be  proved  sufficiently  random  for  n»08t  applications  if  certain  intuitively  acceptable 
conditions  are  satisfied,  A  step  in  this  direction  has  already  been  taken  by  H,  Burke 
Horton  in  [ij  and  by  H,  Burke  Horton  and  R,  Tynes  Dmith  III  in  [2J,  This  paper  presents 
what  is  hopevi  will  be  another  step  in  this  direction. 

In  this  paper,  considerations  will  be  limited  to  the  case  of  binary  digits.  The 


reasons  for  this  are  twofold: 
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(a) .  The  method  used  for  compoundlrv;  the  digits  yields  a  sharp  upper  bound  for  the 

wiAitiminii  bias  of  the  compounded  set  (l.e.,  a  boxind  that  the  maximum  bias  could 
actually  attain)  only  for  the  case  of  binary  digits. 

(b) ,  Mar\y  of  the  experimental  proced\u*es  for  obtaining  approximately  random  digits 

consist  in  first  producing  binaiv  digits  and  then  converting  to  another  nximber 
base.  Thus  binary  digits  are  produced  directly.  Hence,  to  use  the  results 
of  this  paper,  the  only  modification  required  in  these  procedures  would  be  to 
compound  the  binary  digits  before  they  are  converted. 

Now  let  us  consider  some  definitions:  A  set  of  random  variables  each  of  which  can 
assume  only  the  values  0  arrd  1  will  be  referred  to  as  a  set  of  binary  digits.  For  con¬ 
venience*  each  of  the  random  variables  making  up  a  set  of  binary  digits  will  be  called  a 
binary  digit;  this  is  not  to  be  confused  with  the  value  obtained  for  the  random  variable. 

The  absolute  value  of  the  deviation  from  ^  of  the  conditional  probability  that  a  specified 
binary  digit  has  the  value  0  (or  1)  is  called  the  bias  of  that  digit  for  the  given  conditions 
on  the  remaining  digits  of  the  set.  The  maximum  bias  of  a  binary  digit  is  defined  to  be 
the  maximui  of  the  biases  of  that  digit  with  respect  to  all  possible  conditions  on  the 
remaining  digits  of  the  set.  The  taaxlmup  bias  of  the  set  is  the  greatest  of  the  oaximum 
biases  of  the  digits  of  the  set.  A  set  of  binary  digits  is  said  to  be  random  if  Its 
maximum  bias  is  zero. 

The  method  uaed  to  prove  that  a  set  of  compounded  digits  has  a  sufficiently  small 
maximum  bias  is  somewhat  similar  to  the  situation  encountered  in  mathematics  where  one 
begins  with  certain  axioms  and  then  draws  conclusions.  If  the  axioms  are  corirect,  the 
conclusions  ar*e  necessarily  valid.  The  first  step  in  the  compounding  procedure  consists 
in  obtaining  a  set  of  binary  digits  by  some  experiiaental  process  (perhaps  from  a  random 
digit  machine  wfiich  is  base!  on  some  physical  principle).  The  experimental  process  is 
so  chosen  that  there  is  no  doubt  that  the  set  of  binary’  digits  produced  satisfies  the  two 
conditions  i 

(i).  The  maximum  bias  of  the  set  is  leas  than  or  equal  to  some  specified  value  a  (<2)* 
(li).  The  digits  of  the  set  can  be  Jirranged  in  a  specified  array  which  has  the  property 
that  the  rows  of  the  array  are  statistically  independent. 

On  the  basis  of  these  two  assumptions  (which  play  the  same  role  as  the  axioms  mentioned 
above),  it  can  be  proved  that  ttw  maximum  bias  of  the  resulting  compounded  set  of  binary 
digits  never  exceeds  a  specified  value  which  d^ends  on  a.  Moreover,  the  upper  bound  for 
the  maximum  bias  of  the  constructed  set  of  binary  digits  can  be  made  extremely  small  even 
for  large  values  of  a. 
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If  the  experlaental  process  is  suitably  chosen,  conditions  (i)  and  (il)  can  be  satisfied 
beyond  any  doubt.  For  example,  let  us  consider  1000  people  located  In  different  parts  of 
the  world  and  not  in  contact  with  each  other.  Lot  each  person  flip  an  ordinary  coin  high 
in  the  air  so  that  it  will  land  on  a  flat  hard  surface,  record  the  result  (say  0  for  a  tail 
and  1  for  a  head),  and  then  repeat  this  procedure  until  5000  binary  digits  are  obtained.  If 
a  is  sot  equal  to  3/10,  condition  (i)  is  obviously  satisfied  for  the  resulting  set  of 
5,000,000  binary  digits.  Condition  (ii)  evidently  holds  if  the  array  is  taken  to  consist 
of  1000  rows  where  each  row  contains  5000  binary  digits  obtained  from  one  person. 

The  ideal  choice  for  a  would  be  the  actual  naximum  bias  of  the  set  of  binaiy  digits 
obtained  fi^m  the  experimental  process.  Then  the  compounding  procedure  for  obtaining  a  set 
of  digits  with  a  specified  upper  bound  for  the  maximuffi  bias  would  be  simplified;  also  the 
number  of  digits  in  tiie  compounded  set  would  be  a  larger  fraction  of  the  original  number  ef 
digits.  Invariably,  however,  the  proi^erties  of  the  experimental  process  are  not  known  with 
sufficient  accuracy  for  obtaining  anything  but  a  safe  upper  bound  on  the  maxinuB  bias  of 
the  set  of  digits  produced.  This  situation  is  analogous  to  that  of  estimating  the  length 
of  a  stick  which  a  very  rough  measurement  huts  shown  to  be  about  10"  long.  Althou^  one 
might  be  very  hesitant  to  believe  that  the  length  of  the  stick  lies  between  9.9"  «nd 
10.1*'  ,  the  contention  that  the  length  lies  between  5"  and  15"  can  be  accepted  with 
virtual  certainty  and  ar\y  logical  conclusions  based  on  this  contention  can  also  be  accepted 
with  virtual  certainty. 

Given  the  number  of  binary  digits  in  a  set  and  the  maximum  bias  of  the  set,  is  it 
possible  to  determine  whether  the  set  is  suitable  fcr  use  as  a  set  of  random  binary  digits? 

An  important  coimlderation  in  answering  this  question  is  the  use  that  is  to  be  made  of  the 
set  of  digits.  This  must  always  be  token  into  account  befoire  thie  suitability  of  the  set  can 
be  decided.  For  axrtnple,  if  no  more  than  1/1CXX3  of  the  digits  of  the  set  are  to  be  usod  for 
any  particular  situation,  the  set  might  be  satisfactoiy  for  the  types  of  cases  to  which  it 
would  be  applied;  on  the  other  hand,  the  set  might  not  be  suitable  for  cases  of  these  types 
if  all  the  digits  of  the  set  are  used  for  each  situation.  This  example  calls  attention  te 
an  imF>ortant  point,  nanely  that  the  suitability  of  a  set  of  binary  digits  depends  on  the 
number  of  digits  in  the  set.  Let  a  set  have  a  fixed  non-zero  maximuffl  bias  p.  If  the  set 
contains  a  sufficiently  large  number  N  of  digits,  relations  and  expressions  involving  the 
digits  of  the  set  can  be  found  whose  probabilities,  monents,  etc.,  can  differ  greatly  frem 
the  values  which  would  be  obtained  if  the  relations  were  based  on  the  same  nunber  of  txtily 
random  binary  digits.  As  a  sjecific  ex.-mple  consider  the  relation 

All  the  digits  of  the  set  have  the  value  zero. 
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If  th«  reciprocal  of  the  number  of  digits  in  the  set  is  of  the  seas  order  of  magnitude  or 
smaller  t^ian  the  maximum  bias  of  the  set,  the  ratio  of  the  probability  of  this  expression 
to  its  hypothetical  value  can  differ  noticetibly  from  unity.  Thus,  at  least  in  certain 
special  cases,  a  necess^xy  condition  for  the  suitability  of  a  set  of  binary  digits  is  that 
1/W  >  >  p.  This  condition,  however,  is  also  sufficient  for  taoet  situations  to  which  a  set 
of  random  digits  would  be  applied.  The  approximate  sufficiency  of  the  condition  is  a  direct 
consequence  of  the  fact  that  any  set  of  N  binary  digits  can  be  considered  as  a  sample  value 
from  an  N-dimensional  population  consisting  of  2**  discrete  points.  The  1/N  >  >  p  restriction 
implies  that  the  probability  concert. rated  at  each  of  the  2^  polrts  is  very  nearly  equal  te 
the  hypothetical  value  of  ( for  all  poesible  conditions  on  the  ro&aining  digits  of  the 
so^  • 

The  1/N  >  >  p  condition  is  very  satisfactory  from  the  viewpoint  of  probabilities.  The 

probability  of  any  relation  based  on  a  subeet  of  the  digits  of  the  set  (possibly  conditioned 

on  other  digits  from  the  table)  can  be  interpreted  as  the  sum  of  the  probabilities  of  those 

points  included  in  a  certain  region  (defined  by  the  relation)  of  the  N-dimensional  probability 

1  N 

space  ef  the  set  of  digits.  By  expanding  (^  t  p)  it  can  be  shown  that  the  ratio  of  the 
probability  of  any  relation  based  on  one  or  more  digits  from  ths  set  to  the  corresponding 
value  for  a  truly  random  set  of  digits  will  be  very  nearly  equal  to  unity  if  1/N  >  >  p. 

It  is  evident  that  the  higher  order  moments  of  an  expression  based  on  one  or  more  digits 
of  the  set  can  differ  noticeably  fix>m  its  hypothetical  value  even  if  l/N  >  >  p;  any  deviation 
from  the  ideal  situation,  no  matter  how  small,  can  become  important  for  high  order  momenta. 

Fo  '  the  first  few  moments,  however,  deviations  from  the  hypothetical  values  are  not  app]*eciable 
since  these  mooeils  are  based  on  the  probabilities  at  the  2  points  in  the  N-dimensional 
probability  space  and  these  probabilities  are  very  nearly  equal  to  the  hypothetical  value  ef 

In  all  cases. 

The  above  discussion  shows  that  the  values  of  N  and  p  are  sufficient  to  determine  whether 
a  set  of  binary  digits  is  suitable  for  use  as  random  binary  digits  for  a  wide  variety  ef 
situations.  Analogous  considerations  apply  for  digits  to  any  number  base. 

A  magnitude  definition  ef  the  i*elation  1/^  >  >  p  is  difficult  to  specify.  If  p  is  the 
upper  bound  for  the  maximum  bias  of  a  set  of  digits  obtained  by  the  coopounding  procedure 
outlined  in  this  paper,  however,  it  seems  that  a  reasonable  condition  would  be  that  1/N  >  50p. 
This  condition  implies  that  the  probability  of  any  relation  based  on  digits  of  the  set  can  not 
differ  from  its  hypothetical  value  by  more  than  approximately  4^.  In  most  practical  applica¬ 
tions  the  value  obtained  for  p  would  be  noticeably  greater  than  the  tr*ue  vaJ'^a  of  the  maximum 
bias  of  the  compounded  set. 
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Sine*  the  aaxlnuB  nua^r  of  dibits  which  can  be  taken  trca  a  table  Is  the  total  nMiber 
of  digits  in  the  table,  the  above  considerations  surest  that  a  randoa  digit  table  should 
be  constructed  so  that  the  raciprocal  of  the  nunber  of  digits  in  the  table  Is  notleeablx 
greater  than  the  maxisnm  bias  of  the  table.  Any  table  having  this  property  would  bo  satis* 
factoiy  for  cost  situations  to  which  it  would  be  applied. 

Now  let  us  consider  two  different  compounding  methods  which  produce  Sets  of  blnaiy 
digits  with  the  sane  upper  bound  for  the  majdnii-  bias.  If  the  computational  dlffleultioo 
of  applying  the  two  methods  are  of  co-ipar-ible  nagnitudes,  it  seems  reasonable  to  prefer  tlio' 
method  which  yields  the  lar?*ei-  jet  of  digits.  For  e.  if  the  msnber  of  digits  In  tho 

set  obtained  by  the  first  method  is  only  1/3  of  the  original  n’jiabor  of  digits  the 

number  in  the  set  obtained  by  the  second  method  is  1/3  of  the  original  number,  the  second 
method  would  see-u  preferable  even  If  it  required  as  much  as  100^  more  computation.  The 
compounding  method  presented  in  this  paper  has  tho  property  that  the  number  of  digits  In 
the  compounded  set  can  be, held  to  a  reasonably  large  fraction'  of  the  original  number  of 

I 

digits  at  the  same  time  that  the  upper  bound  for  the  mrt:djmim  bias  is  made  extremely  small* 
The  method  presented  by  t-erton  in  flj  does  not  ^,.^a  this  property.  Fbr  example,  lot 
o  ■  l/lO.  Appl^^ing  Horton's  method,  when  the  compounded  set  consists  of  1/3  of  tho  orlginol 
number  of  digits  the  upper  bound  for  the  m.axLimim  bias  is  12,3  x  lO"^,  The  exaspls  presented 
In  section  3,  however,  shows  that  a  compounded  set  vbose  number  of  digits  sqtiols  i/3  of  tho 
original  number  and  which  has  an  upper  ILdt  of]1.7  x  10  '  for  the  mi>3c4iinf»i  blss  con  bo 
obtained  using  the  method  presented  in  the  nB;d.  section. 

Although  the  compounding  taethod  outlined  in  seeti  >n  3  Is' presented  os  s  series  of  stsps, 
the  value  of  a  digit  of  the  compounded  set  can  be  written  as  a  linear  fbnctlon  (mod  2)  of 
digits  of  the  original  set.  This  was  not  done  in  what  follows  because  of  the  complieatod 
nature  of  the  general  form  of  such  eoepressions.  In  particular  casa,  however,  these' 
expressions  can  be  v/rltten  without  much  trouble  and  the  conpoiuxded  digits  computed  from  the 
original  digits  in  a  single  step.  , 

.  3*  Outline  of  compounding  method  and  statement  of  theorems.  This  section  contoins  o 
description  of  the  compounding  method  mentioned  in  the  preceding  two  septione  as  well  ao 
statements  of  the  basic  theoraas  concerning  this  compounding  method.  Pi^ofe  of  the  results 
stated  In  this  section  are  given  in  section  4* 

Let  us  consider  the  array  of  nn  binary  digits 


*U*  *12*  —  •  *ln 
*22*  *’*  »  *2n 
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which  satisfies  conditions  (1)  and  (il);  i.e,,  the  maxtoum  bias  of  the  set  (1)  is  less  than 
or  equal  to  a  while  a  digit  x  is  independent  of  a  digit  x  if  r  tt  (if  r  ■  u,  however. 
X.  is  not  necessarily  independent  of  x  ). 

UT  pf 

Let  a  new  set  of  (^l)n  binary'  digits 
(2)  »■  (i  •  l,‘'*,n»-l|  J  -  l,***,n) 

be  formed  as  follows! 


fjj  -  3^  ♦  3C^j  (“od  2),  (1  -  l,*“,n-l;  j  -  l,*»*,n). 


Then  the  biases  of  the  have  the  properties 


Sisasa.  n  b.  a  isssiogd  at  •£  t-i  of  yy.-.  y(^„j, 

^  i  whiJ-w  V  is  a  specified  set  of  zero  more  of  the  y  's  with  q  ^  i.  Also  let 

•  eoiy^ft  of  ^  att  of  integers  such  that  P  if  y^j  (U.  Then.  If  "  maximmi  bias  for 
SSi 

f*<yij  •  ®l“> « -  iU  ''i[^  -  -  0/(1  ♦  0]/&  •  -  0/(i  • 

fO£  ^  possible  selections  of  U,  V  aM  of  ^  values  for  the  digits  of  these  seta. 

h  U  exac^  t-1  o£  y(i^l)j»*'**y(ra^l)j  liSia  }B!SS!R 

bias  of  tto  binary  digit  y^^  is  less  than  or  equal  ^ 

a[l  -  g  -  a)V(|  ♦  a)^]/[l  ♦  (|  -  «)Vg  ♦  o)^J  . 

jOQjy^ag^.  ^  maxiwp  bias  oj[  ^  set  (2)  ^  less  than  or  tmual  ^ 

«&-(!-  »r/(i  ‘  «r]/[i  ♦  (I  -  «r/(i .  .rj . 


The  basic  operation  in  the  method  of  compounding  blnaiy  digits  is  outlined  in  the 
procedure  given  for  obtaining  the  y^^  from  the  Let  m  -  (l^tj^)***(lMjj).  Then  a  set 

®f  ^***^j®  binary  digits  can  be  obtained  fron  tlie  original  set  of  mn  digits  ty 
continually  applying  this  basic  procedure.  The  first  step  consists  in  dividing  the  rowo 
®f  (1)  into  (lH2)***(l^t|j)  sets  each  consisting  of  (l^tj^)  rows  in  sons  specified  fashion. 
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Each  of  tJ'.eso  acts  is  an  array  of  x  n  binary  dicits  for  which  ths  rows  ars  indspsnd- 

ent.  Apply  the  nsthod  used  to  obtain  the  froo  the  to  each  x  n  arr^ 

separ  tely.  Then  each  array  yields  a  set  of  tj^n  binary  dicits  and  there  ars  (lH2)***(lHu) 
such  sets.  In  each  set  arrance  the  tj^n  dicit?  into  a  sir^gle  row  in  sooe  specified  ■anner* 
This  furnishes  a  ne.-;  array  of  pl^t2)***(l^tj^)3  x  (tj^n]  binary  dicits  for  which  the  rOMS  are 
independent*  Repeat  this  procedure  with  respect  to  t^  thus  obtaininc  a  new  array  Ot 
C(l»t-)**«(lt-tj^)]  X  [tj^t^n]  binary  digits  for  vrtiich  the  rows  are  independent;  ete.^  until  e 

binary  licit  array  for  which  the  rows  are  indejiendent  Is  obtained* 

Then  fom  a  set  of  binary  dijlts  (g  -  l,*..,t^j  b  -  !,•••,  from  this  arr^ 

in  exactly  the  sane  nanner  that  the  y^j  were  obtained  fron  the*  Then  the  biases  of  tlw 

’'.h  have  the  properties 

Theorea  2.  iJ^.****  *1,^  be  defined  by  3  »  a  and 

-  (i  -  ♦  ^,-1  •  ft  -  ^^if-'/ft  •  (w  - 1.-. «). 

Tnen,  if  exactljf  t-1  of  known  values.  (1  <  t  <  t^), 

the  ^djaum  bi.;s  of  the 

^ch  is  less  than  or  egu^  ^ 

"  (i  "  -’k-JMI  *  (2  "  »^K.i)M2  ^ 

In  P~trticul:^r «  the  irt^ixiinun  b^is  of  the  entire  set  of  is  less  than  o£^ 

-  (2  “  ^  (I  - 

K  ,  JC-2  ^K-l  JL 


to 


(3) 


i  - 


,2-1 


•  ^  •  ^K-1 


‘'K-2 


t 


2K.2 


The  ine^;uality  (3)  is  frequently  useful  from  a  conputational  viewpoint*  Although  the 
right  htmd  side  of  (3)  is  usually  noticeably  greater  than  the  le,ft  hand  side,  in  nat^  eases 
this  rough  upper  bound  is  itself  small  enough  to  show  that  the  upper  bound  for  the 
bias  is  of  the  desired  order  of  magnitude* 

If  the  set  of  caapounded  digits  is  to  be  used  for  a  randan  binary  digit  table,  Theorea  2 
^  shows  that  advantage  can  be  taken  of  the  position  of  the  digits  in  the  table*  Let  M  • 

I  ^K-l"  ^he  (g  -  h  -  into  the  table  in  the 


order 


^12*  ***  •  ^,1 


2i» 


.  Ion.  I 


a»  *3i» 


.  I. 


V'  "■ '  \r 
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Th«n,  if  a  set  of  dii^its  is  taken  fron  this  table  in  consecutive  order  follows 

the  upper  bound  for  the  niaximun  bias  of  this  set  is  dependent  on  the  number  L  of 

dibits  in  the  set.  From  Theorem  2,  the  .•arodiaun  bias  of  a  set  of  L  dibits  taken  in  consecutive 

order  from  a  table  fomed  in  this  manner  is  less  than  or  ecinal  to 


^-1&  “  (2  "  ^-1)  ^  ^K-l)  ]/[^  *  (l  ■  ^K-l)  *  ^K-l)  ] 


for  values  of  L  such  that  (t-l)M  <  L  <  tM,  where  1  ^  t  ^  tj.  Thus,  if  a  small  set  of  dibits 
is  taken  from  this  table  in  consecutive  order,  the  upper  bound  for  the  maxiaum  bias  of  this 
set  will  usually  be  noticeably  smaller  than  the  upper  bound  for  the  :aaxiiBum  bias  of  the  table. 
Since  many  uses  of  a  random  di^t  table  require  only  a  small  fraction  of  the  total  number  of 
entriee  in  this  table,  this  property  would  seem  to  be  desirable.  It  should  be  emphasized, 
however,  that  the  maximum  bias  of  a  set  taken  from  this  table  is  always  less  than  or  equal  to 
3^  irrespective  of  the  positions  that  the  digits  of  the  sets  occupy  in  the  table.  Thus  nothing 
is  lost  by  constructing  the  table  in  this  manner  but  sonething  can  be  gained  for  small  sets  If 
the  digits  are  taken  fron  the  table  in  consecutive  order. 

Now  let  us  consider  situations  in  which  it  is  required  that  the  number  of  digits  in  the 
compounded  set  is  at  least  a  specified  fraction,  say  l/C,  of  the  original  number  mn  of  binary 
digits.  This  requires  that  K  and  ^^»***$\  ^  chosen  so  that 

tj^***tj/(l^tj^)***(l^tjj)  ^  l/C. 


Also,  for  given  values  of  K  and  C,  it  seems  preferable  to  choose  ^i****»^  that  the  value 
Qf  a  is  at  leaek  approxinfitely  minimized,  Elxanination  of  the  results  of  Theoren  2  indicates 
that  a  reasonable  method  of  determining  the  values  of  wl-t-h  this  in  mind  consists  in 

first  chooeing  as  as  possible,  then  (given  the  value  of  equal  to  its  minimum 

vailue)  choosing  small  as  possible,  etc.  This  method  is  also  recouuuended  by  the  fact 

that  the  resulting  values  of  t2^****»t|j  are  readily  determined.  The  explicit  procedure  for 


finding  tj^***’ 


,t^  is  given  ty 

,  Let  the  values  of  the  intej-er  K  and  the  constant  C  (>  1)  ^  given  and  consider 


tj^***tj/(l**tj^)**»(l^tj^)  ^i/c. 
value  of  ^  the  smallest  integer  s  ttisfyine 

>  1/(C-1). 
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^  general.  ^  <  w  ^  K-1,  having  .ilrealy  detemined  their  miniaum  veluee . 

^  value  of  ^  ohe  saallest  Integer  ait.jsfying 

I  (i^t^.i)  -  1]  . 

I  Finally .  riven  ^  their  ninigaiw  values,  the  nlniaup 'value  of  tj  ^  the 

integer  satisfying 

4  >i/^i”*tjj.i/(i*t^)—(i*tj.i)  -1]  . 

Now  consider  the  j^*neral  situation  encoxontered  in  the  •'.ppllcation  of  the  compounding 


4 

\ 

t 


I 


process  outlined  above.  Here  the  values  of  o,  C  are  £iven  and  it  is  required  to  choose  K 
and  ^^****»^  so  that  the  Tip])er  bound  for  the  naxiMiir.i  bias  of  the  coapounded  set  of  t^***t^ 
binary  digits  is  less  than  or  equ  J.  to  a  specified  value  b.  The  following  procedure 
furnishes  a  nethod  of  solving  this  problemt 

Let  K  ^  1,  obtain  t^  according  to  Theorem  3,  and  then  compute  0^.  If  <  b,  a  solution 
has  been  obt.dned.  If  >  b,  let  K  ■  2  and  repeat  the  procedure  to  obtain  ^2  ^ 

the  values  of  and  K  ■  2  are  a  solution.  If  repeat  the  procedure  fOr  K  •  3|  etc. 

In  practical  situations,  the  value  of  K  is  usually  bounded  (e.g.,  by  independence  properties  of 
the  original  set  of  digits).  If  is  still  great •?r  than  b  for  the  Liaxlmai  pen&issible  value 
of  K,  no  solution  is  obtained.  This  .sans  that  either  b  must  be  increased  or  l/C  decreased  or 
both  if  a  solution  is  to  be  founi.  In  many  cases,  a  large  amount  of  coc\p'atatlon  can  be  avoided 
by  using  the  inequality  (3).  for  marginal  situations,  however,  a  solution  may  be  miased  by 
using  (3)  instead  of  computing  pj^. 

Sxample  of  method.  The  following  table  represents  an  example  of  applicatim  of  the  above 
aethodt 


a."  iAP _  i/c  ■  1/3 

.  I  -  1,  tj^  -  1 

K  -  2,  -  1,  -  2 

K  -  3,  -  1,  -  3,  -  9 

K  •  4,  -  1,  -  3,  -  10,  -  44 

Thus  K  -  4*  “  1,  ■  3#  t^  ■  10,  ■  44  is  a  solution. 


b  ■  2  X  10*^ 

Pj^  -  2  X  10“^ 

P2  *  1.6  X  10“^ 
p^  *  1.04  X  10*^ 
0^  «  1J.7X  10"^  . 


4.  Derivations.  The  purpose  of  this  section  is  to  furnish  proofs  of  the  results  stated 
in  the  preceding  sections. 

^♦•1  2roof  of  Theorem  1.  Let  us  consider  the  conditional  probability  that  an  arbitrary  but 
fixed  y^^j  lias  a  specified  value  when  the  values  of  a  fixed  subset  of  sero  or  more  of  the  romalxi* 
Ing  y's  are  known.  For  convenience,  assine  that  y^j^  is  the  binary  digit  considered  and  that 


4 
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values  of  ^31*****^tl  ^  fixed  intef^er  such  that  1  <  t  <  ni-1)  *'-nd  a  set 

re  given  while  the  values  of  the  renaining  y's  arc  unknown.  Here  3  represents  an  arbitrary 
fixed  set  of  zero  or  itore  of  the  '*bich  j  >  2  while  t  -  1  has  the  Interpretation 

t  none  of  the  (1  >2),  are  ^iven.  Let 

Pr(x^  -  0|S)  -  I  ♦  and  Pr(Xj,^  -  bj^|S)  •  ^  \  »  (k  -  l,*»',t). 

n,  using  the  independence  conJitions  satisfied  by  the  x'b, 

M/u  •  S) 

■  [X  ‘  *  X 

-  f  •  ajS. 

4  |5  !•  (1-J’)/(1*F)  If  0  <  P  <  1  and  equals  (P-1)/(1*P)  If  P  >  1,  where  P  • 

(4  -  Ty  t>e  the  aaxiraum  bias  for  the  set  of  binary  dibits  *^2'****^ur'* 

-  1,***,b),  Then  it  is  easily  seen  that 

IS  I  i  [i  -  X  *  0  /  ^  *  J2  (I  -  \y(i  *  ^k)  • 

ue 

h  •  ‘I'ya  .  b,,-.  /u  -  b,,  3).i| 

s  1^1 1  -  X  *  ■'k)]/!^  *  X  -  ''k)''(i  *  \) 

)r  all  possible  selections  of  ^j^****#^^  possible  selections  of  S  nni  the  values  for 

1#  digits  of  3,  It  is  to  be  observed  that  this  Lnequality  is  valid  for  t  •  1, 

Evidently  t.^ds  result  can  be  nodifiod  to  apply  to  an  arbitrary  y^j  for  which  t-1  of 

^(i^l)  J' *  *  **^(n>-l)  j  Siven  values.  This  obvious  modification  results  in 

ueorem  1 • 
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^,2  Proof  of  Thtor<p  '2«  ^Jr  Corollary  2,  the  na.<iTauni  biaa  of  the  ^1^2)  *  * *^*1 
array  la  less  than  or  e  ^ual  to  0^.  In  general,  ^  ^  ^  ^  Corollary  2,  the  maxlrniai  bias 

of  the  ^  [yi***^wn^  arrfiy  fa  less  than  or  equal  to  0^,  Finally,  tgr 

Corollary  1,  if  exactly-  t-1  of  ^xh*  *  *  *  valuea,(l^l^)» 

the  m^xlJavaa  bias  for  the  binary  digit  ia  less  than  or  equal  to 

h-l^  -  (|-  •‘K-lt/Cl  ♦  3k-1  t]/[^  *  • 

The  inequality  (3)  la  ui  innedlate  consequence  of  the  relation 

a[l  -  (i  -  (i)/(i  .  a)]/[l  ♦  d  -  a)/(|  ♦  o)]  £2.a^  . 

4.3  Proof  of  Th.eorem  3.  From  the  given  condition 
tj^  >  ♦  t^)***(l  ♦ 

Fi'on  this  ineciuality  for  it  follows  that 

Ct^*'*tj^.l/(1  ♦  *  Vl^  -  1  >  0. 

Thus 

Vl  ^  -  ij. 

In  general,  3  <  v  <  K-1,  f^iven 

^  >  i/[oti-q.lAl  ♦  q)-(l  ♦  q.i)  -  l] 

it  follows  that 


Ct^-"t^x/^^  ♦  t^)*«*(l  ♦  t^^^)  -  1  >  0 

w!  e:  c 

K.1  >  y  • 

Fin  illy 

q  >  i/(c  -  1). 
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